This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the 
original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problems Mailbox. 



1*n 



CM 

< 

CM 

00 

CO 



(19) 




(12) 



(43) Date of publication: 

06.08.1997 Bulletin 1997/32 

(21) Application number: 97101612.6 

(22) Date of filing: 03.02.1997 



Europaisches Patentamt 
European Patent Office 

OfVice uropeen des brevets (11) EP 0 788 279 A2 ^ /{ ^ 

EUROPEAN PATENT APPLICATION 

(51) Int. CI. 6 : H04N7/08 



(84) Designated Contracting States: 


• Usui, Akira 


DE FR GB 


Osaka-fu, Takatsuki-shi, 569 (JP) 




• Imai, Kiyoshi 


(30) Priority: 05.02.1996 JP 19175/96 


Kyoto-fu, Kyoto-shi, Nakagyo-ku, 604 (JP) 




• Hagiwara, Kiyokazu 


(71) Applicant: MATSUSHITA ELECTRIC INDUSTRIAL 


Mie-ken, Nabari-shi, 51 8-04 (JP) 


CO., LTD. 




Kadoma-shi, Osaka 571 (JP) 


(74) Representative: Kugele, Bernhard et al 




NOVAPAT INTERNATIONAL SA, 


(72) Inventors: 


9, Rue du Valais 


• Nishto, Toshiro 


1202 Geneve (CH) 


Osaka-fu, Hirakata-shi, 573 (JP) 





(54) Television receiver and additional information transmitting method 



(57) A television receiver receiving an analog video 
signal, comprises additional information detecting 
means for separating and extracting an additional infor- 
mation code from the analog video signal, and output- 
ting the additional information code; additional 
information recording means for recording the addi- 
tional information code output from the additional infor- 
mation detecting means: additional information writing 
switch means for passing or blocking the additional 
information code that is output from the additional infor- 
mation detecting means toward the additional informa- 
tion recording means, in response to a control signal; 
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conversion means for converting the additional informa- 
tion code output from the additional information detect- 
ing means or the additional information code 
reproduced from the additional information recording 
means into a character or an image; and signal synthe- 
sizing means for synthesizing the analog video signal 
and the additional information that has been converted 
into a character or an image by the conversion means, 
and outputting the synthesized signal as a monitor out- 
put signal. 
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Descripti n 

FIELD OF THE INVENTION 

5 The present invention relates to a television receiver, and an additional information transmitting method for trans- 

mitting a television signal in which a program or commercial and additional information relating to, or more specific than, 
the program or commercial are multiplexed. More specifically, the invention relates to a television receiver that can col- 
lect and record the additional information as desired, and a method for multiplexing the additional information with an 
MPEG2-Video stream. 

10 

BACKGROUND OF THE INVENTION 

In recent television broadcasting, "multiple broadcasting" for transmitting a television signal in which an ordinary 
program or commercial and information relating to. or more specific than, the program or commercial are multiplexed 
is by VBI multiplexing or FM multiplexing, has been put to practical use. This broadcasting system has an advantage over 
conventional systems in that it can transmit more information within a given broadcasting time. However, for the user 
who receives the information, it is necessary to set the receiver in the multiple broadcast receiving mode and refer to 
the additional information all the time. This sometimes results in oversupply of information, and means for arranging a 
flood of information is needed. 

so However, there has conventionally been no television receiver capable of arranging such additional information with 
high efficiency. Hence, under the existing circumstances, the user sets the receiver in the multiple broadcast receiving 
mode to receive the additional information and displays the information on the screen to see the information. As a 
method for recording the received additional information, it is thinkable to record the information received in the multiple 
broadcast receiving mode as it is in a video recorder or the like. In this case, however, to record only required informa- 

25 tion, the recording operation of the video recorder must be performed only when the required information appears, while 
referring to the additional information displayed on the screen, and this process is very complicated. 

SUMMARY OF THE INVENTION 

30 It is an object of the present invention to provide a television receiver that can select at user's request, additional 
information being broadcasted simultaneously with a broadcasted program and that can rearrange the additional infor- 
mation to make a data base. 

It is another object of the present invention to provide a television receiver that can be applicable to digital broad- 
casting and that can take only desired additional information by selecting, at user's request, an icon displayed in a pre- 
35 scribed position on a picture. 

It is still another object of the present invention to provide an additional information transmitting method wherein a 
digitally coded television signal and additional information are efficiently multiplexed and transmitted. 

Other objects and advantages of the invention will become apparent from the detailed description that follows. The 
detailed description and specific embodiments described are provided only for illustration since various additions and 
40 modifications within the spirit and scope of the invention will be apparent to those of skill in the art from the detailed 
description. 

According to a first aspect of the present invention, a television receiver receiving an analog video signal, com- 
prises additional information detecting means for separating and extracting an additional information code from the ana- 
log video signal, and outputting the additional information code; additional information recording means for recording 

45 the additional information code output from the additional information detecting means; additional information writing 
switch means for passing or blocking the additional information code that is output from the additional information 
detecting means toward the additional information recording means, in response to a control signal; conversion means 
for converting the additional information code output from the additional information detecting means or the additional 
information code reproduced from the additional information recording means into a character or an image; and signal 

so synthesizing means for synthesizing the analog video signal and the additional information that has been converted into 
a character or an image by the conversion means, and outputting the synthesized signal as a monitor output signal. 

According to a second aspect of the present invention, a television receiver receiving a digitally coded television 
signal, comprises digital television signal analyzing means for analyzing the digitally coded television signal, separating 
and extracting additional information included in the television signal from the television signal, and outputting the addi- 

55 tional information as an additional information code; additional information recording means for recording the additional 
information code output from the digital television signal analyzing means; additional information writing switch means 
for passing or blocking the additional information code that is output from the digital television signal analyzing means 
toward the additional information recording means, in response to a control signal; conversion means for converting the 
additional information code output from the digital television signal analyzing means or the additional information code 
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reproduced from the additional information recording means into a character or an image; digital television signal 
decoding means for decoding the digitally coded television signal and outputting a video signal; and signal synthesizing 
means for synthesizing'the video signal output from the decoding means and the additional information that has been 
converted into a character or an image by the conversion means, and outputting the synthesized signal as a monitor 
5 output signal. 

According to a third aspect of the present invention, in the above-mentioned television receiver, the control signal 
controls the additional information writing switch means so that it passes the additional information code only when 
additional information designated by the user is detected. 

According to a fourth aspect of the present invention, a television receiver receiving a digitally coded television sig- 

10 nal f comprises digital television signal analyzing means for analyzing the digitally coded television signal, separating 
and extracting additional information included in the television signal from the television signal, and outputting the addi- 
tional information; image signal outputting means for decoding the digitally coded television signal with reference to the 
additional information output from the analyzing means, and outputting detailed information relating to the additional 
information as an image signal; image signal recording means for recording the image signal output from the image sig- 

is nal outputting means; image signal writing switch means for passing or blocking the image signal that is output from the 
image signal outputting means toward the image signal recording means, in response to a control signal; digital televi- 
sion signal decoding means for decoding the digitally coded television signal and outputting a video signal; and signal 
synthesizing means for synthesizing the video signal output from the decoding means and the image signal output from 
the image signal outputting means or the image signal read from the image signal recording means, and outputting the 

20 synthesized signal as a monitor output signal. 

According to a fifth aspect of the present invention, in the above-mentioned television receiver, the digital television 
signal analyzing means separates and extracts a channel number or a still picture number including detailed informa- 
tion, as additional information, from the digitally coded television signal. 

According to a sixth aspect of the present invention, in the above-mentioned television receiver, the control signal 

25 controls the image signal writing switch means so that it passes the image signal only when additional information des- 
ignated by the user is detected. 

According to a seventh aspect of the present invention, a television receiver receiving a digitally coded television 
signal, comprises digital television signal analyzing means for analyzing the digitally coded television signal, separating 
and extracting additional information that shows the position of an image on a picture, which image is obtained by 

30 decoding the digitally coded television signal, from the television signal, and outputting the additional information; 
means for displaying an icon in a position on a monitor screen, which position is specified by the additional information 
output from the digital television signal analyzing means; means for selecting the icon; and image signal outputting 
means for decoding the digitally coded television signal when the icon is selected, and outputting, as an image signal, 
detailed information that is transmitted corresponding to the position of the icon. 

35 According to an eighth aspect of the present invention, the above-mentioned television receiver further comprises 
detailed information recording means for recording the detailed information. 

According to a ninth aspect of the present invention, in an additional information transmitting method for transmit- 
ting a digitally coded television signal in which a program or a commercial and additional information relating to, or more 
specific than, the program or commercial are multiplexed, additional information to be transmitted is written in a user 

40 data region of the digitally coded television signal when the additional information is transmitted. 

According to a tenth aspect of the present invention, in the above-mentioned additional information transmitting 
method, transmitted as the additional information are a code showing an object that provides information, and one of a 
character information code and an image information code, which shows information of the object. 

According to an eleventh aspect of the present invention, in the above-mentioned additional information transmit- 

45 ting method, transmitted as the additional information are a code showing an object that provides information, and one 
of the number of a channel transmitting detailed information of the object and the number off a still picture displaying th 
detailed information of the object 

According to a twelfth aspect of the present invention, in the above-mentioned additional information transmitting 
method, transmitted as the additional information are a code showing the position of an image on a screen, which 

so image is obtained by decoding the digitally coded television signal, and one of the number of a channel transmitting 
detailed information corresponding to the position and the number of a still picture displaying detailed information cor- 
responding to the position. 

According to a thirteenth aspect of the present invention, in the above-mentioned additional information transmit- 
ting method, an MPEG2- Video stream is employed as the digitally coded television signal. 

55 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram illustrating a fundamental structure of a television receiver according to the present 
invention. 
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Figure 2 is a block diagram illustrating another fundamental structure of a television receiver according to the 
present invention. , , 

Figure 3 is a block diagram illustrating a television receiver according to a first embodiment of the invention, on the 
basis of the structure shown in figure 1 . 
5 Figure 4(a) is a diagram illustrating a waveform of a line that shows the start of additional information of an NTSC 

signal input to the television receiver according to the first embodiment, and figure 4(b) is a diagram illustrating a wave- 
form of a line that shows data of the additional information of the NTSC signal. 

Figure 5 is a block diagram illustrating a television receiver according to a second embodiment of the invention, on 
the basis of the structure shown in figure 2. 
10 Figure 6 is a block diagram illustrating a television receiver according to a third embodiment of the present inven- 
tion, on the basis of the structure shown in figure 2. 

Figure 7 is a block diagram illustrating a television receiver according to a fourth embodiment of the invention. 

Figure 8 is a block diagram illustrating a television receiver according to a modification of the fourth embodiment, 
wherein MPEG2-System Standard is employed. 

15 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[Embodiment 1] 

20 Figure 1 is a block diagram illustrating a fundamental structure of a television receiver receiving an NTSC (National 
Television System Committee) video signal, according to the present invention. As shown in figure 1 , the television 
receiver comprises an additional information detecting means M1 for separating and extracting an additional informa- 
tion code from the NTSC video signal 10 and outputting the additional information code; an additional information 
recording means M5 for recording the additional information code output from the detecting means M1 ; an additional 

25 information writing switch means M4 for passing or blocking the additional information code that is output from the 
detecting means M1 toward the recording means M5, in response to a control signal M3; a conversion means M2 for 
converting the additional information code output from the detecting means Ml or the additional information code read 
from the .recording means M5 into a character or an image; and a signal synthesizing means M7 for synthesizing the 
NTSC video signal and the additional information that is converted into a character or an image by the conversion 

30 means M2, and outputting the synthesized signal as a monitor output signal. The television receiver so constructed can 
select desired information from television signals in which an ordinary program or commercial and other information 
(additional information) relating to, or more specific than, the program or commercial are multiplexed, and collect and 
record the additional information. The collected and recorded additional information can be utilized in many ways as a 
data base. 

35 As the control signal M3. a recording request signal which is input to the receiver directly by the user who requests 
recording of the additional information is employed. Further, the receiver may be provided with a code comparing 
means which retains a code (key word) that shows the additional information for which the user requests recording, and 
outputs a signal that makes the additional information switch means M4 pass the additional information code output 
from the additional information detecting means M1 when the additional information code includes the key word. In this 

40 cas , the output signal from the code comparing means can be used as the control signal M3. When the receiver 
includes such a code comparing means, only desired additional information is automatically stored in the additional 
information recording means M5 after a given period of time, by setting the key word in advance, with no necessity of 
user's requesting recording of the additional information from the outside. 

Figure 3 is a block diagram illustrating a specific structure of a television receiver according to a first embodiment 

45 of the invention, on the basis of the fundamental structure shown in figure 1 . In figure 3, reference numeral 1 1 desig- 
nates an additional information display request signal input by the user, and reference numeral 1 2 designates an addi- 
tional information recording request signal input by the user. The recording request signal 12 corresponds to the control 
signal M3 shown in figure 1. Reference numeral 13 designates an additional information reproduction request signal 
from the user. Reference numeral 100 designates a 21st line analyzing means for receiving the NTSC signal 10 and 

so detecting the 21 st line to decide whether the additional information is transmitted or not Reference numeral 1 8 desig- 
nates a signal indicating that the additional information is transmitted through the 21st line analyzing means 100. Ref- 
erence numeral 101 designates an AND circuit for receiving the additional information display request signal 1 1 and the 
signal 18, and controlling ON/OFF switching of an additional information detecting means 102 on the basis of these sig- 
nals. The additional information detecting means 102 corresponds to the additional information detecting means M1 

55 shown in figure 1 . This additional information detecting means 102 receives the video signal 14 transmitted through the 
analyzing means 100 and, when it is turned on by a control signal 15 from the AND circuit 101 . it separates and extracts 
the additional information from the video signal 14 and outputs the additional information. Reference numeral 103 des- 
ignates a code/character - image conversion means for converting additional information codes 16a and 16b into char- 
acters or images, and this means 103 corresponds to the conversion means M2 shown in figure 1 . Reference numeral 
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104 designates a frame memory for temporarily storing the converted additional information. Reference numeral 105 
designates a signal synthesizing means for synthesizing the NTSC video signal 10 and the additional information signal 
stored in the frame memory 1 04, and outputting the synthesized signal as a monitor output signal 1 7. The frame mem- 
ory 1 04 and the signal synthesizing means 1 05 correspond to the signal synthesizing means M7 shown in figure 1 . Ref- 

5 erence numeral 108 designates a recording medium, such as an HDD (Hard Disk Drive), for recording and storing the 
additional information code 16a output from the additional information detecting means 102. The recording HDD 108 
corresponds to the additional information recording means M5 shown in figure 1. Reference numeral 106 designates a 
switch for authorizing the recording HDD 108 to record the adcfltional information code 16a output from the detecting 
means 1 02 when a recording request signal 1 2 is input. This switch 1 06 corresponds to the additional information writ- 

70 ing switch means M4 shown in figure 1 . Reference numeral 107 designates a switch for reading the additional informa- 
tion recorded in the recording HDD 108, and outputting the additional information toward the code/character * image 
conversion means 103 when a reproduction request signal 13 is input. 

A description is given of the operation of the television receiver according to the first embodiment of the invention. 
Figure 4(a) shows a waveform of a line that shows the start of additional information in the NTSC video signal 10, and 

is figure 4(b) shows a waveform of a line that shows data of additional information in the NTSC video signal 10. In order 
to inform that transmission of additional information is performed, as shown in figure 4(a), the received NTSC signal 10 
is subjected to multiplexing using VBI (Vertical Blanking Interval) to produce a waveform on the 21st line, which wave- 
form informs that a commodity code will be sent next, and as shown in figure 4(b), a character code, for example, a JIS 
code, is sent by another line, for example, the 22nd line. Assuming that the pulse width T is 1/(4 x f sc ), since the color 

20 subcarrier frequency f sc in the NTSC system is 3.58 MHz, the pulse width T is 70 nsec. Although one line consists of 
910 dots, since a portion of the line is already used by the horizontal synchronous pulse and the color burst, the effec- 
tive length of the line for the signal is 768 dots. When Chinese characters are used, since 16 bits (dots) are needed for 
coding of one Chinese character, 48 (= 768/16) characters can be transmitted per one line. 

It is possible to transmit graphic information, instead of characters, in the form of a bit map. However, the transmis- 

25 sion capacity is limited in the NTSC system. For example, when image data is transmitted by 24 bits, in the order of Red, 
Blue, Green, at 8-bit resolution, data of 32 dots (= 768/24) can be transmitted by one line. So, in order to transmit a 256 
x 256 bit map, 2048 lines (= 256 x 256/32) are needed. Assuming that one line is used in one field, 2048 fields are 
needed. Since 60 fields are transmitted in one second, it takes 34 seconds (2048/60) to transmit the 256 x 256 bit map. 
Consequently, there is a limitation in the size of image data that can be actually transmitted. 

30 When both the additional information display request signal 1 1 and the signal 18 which shows that the additional 
information is currently being transmitted are input to the AND circuit 101, the additional information detecting means 
102 is turned on, and the detecting means 102 extracts the additional information code 16a of 48 characters per one 
line from the video signal 14. This additional information code 16a is recorded in the recording HDD 108 when the 
switch 106 is turned on by the recording request signal 12. Meanwhile, the additional information code 1 6a is converted 

35 into characters by the code/character • image conversion means 103 t and character data for one picture is stored in the 
frame memory 1 04. The signal synthesizing means 1 05 synthesizes the NTSC video signal 1 0 and the character data 
stored in the frame memory 104, and outputs a monitor output signal 17. 

On the other hand, when the reproduction request signal 13 from the user is input to the switch 107, the switch 107 
is turned on, and data 16b of the additional information recorded in the HDD 108 is read from the HDD 108. The addi- 

40 tional information data 16b is converted into character information by the code/character • image conversion means 
1 03, and character information for one picture is stored in the frame memory 1 04. Thereafter, the character information 
is output, through the signal synthesizing means 105, as a monitor output signal 17. When the NTSC video signal 10 
is input to the receiver, the character information is synthesized with the video signal that is currently being received, 
and displayed as character data. When the NTSC video signal 10 is not input to the receiver, only the character infor- 

45 matton is displayed. 

When the video signal and the character data are synthesized by the signal synthesizing means 1 05, they are proc- 
essed so that the monitor signal 17 can be displayed by screen splitting into two pictures. 

In the foregoing description, the additional information code 16a is recorded when the recording request signal 1 1 
from the user is input. However, when a commercial is broadcasted, a commodity code requested by the user is 
so reserved in advance, and this commodity code is compared with the commodity code transmitted by the 21st line. Only 
when the requested code matches the transmitted code, the additional information is recorded in the recording HDD 
108. In this case, after a given period of time, a data base wherein information desired by the user is stored is automat- 
ically created. 

As described above, according to the first embodiment of the invention, in the NTSC system television receiver. 
55 additional information, which is transmitted with a video signal, is extracted by the additional information detecting 
means 102, and the extracted additional information is recorded in the recording HDD 108 in response to the recording 
request signal 12 from the user. On the other hand, the recorded additional information is reproduced from the HDD 
108 in response to the reproduction request signal 13 from the user, and displayed. Therefore, the real-time displayed 
additional information can be cataloged, and the user can see the catalog anytime, resulting in effective use of the addi- 
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tional information. Furthermore, when the kind of additional information desired by the user is reserved in advance, only 
the desired additional information is selected and automatically cataloged. That is, the user can qpllect thp additional 
information when a given period of time has passed, resulting in highly efficient information collection. 

5 [Embodiment 2] 

Rgure 2 is a block diagram illustrating a fundamental structure of a television receiver receiving a digitally coded 
video signal, according to the present invention. As shown in figure 2, the television receiver comprises a digital televi- 
sion signal analyzing means M8 for analyzing the digitally coded video signal 20, separating and extracting additional 

10 information from the video signal 20, and outputting the additional information as an additional information code; an 
additional information recording means M5 for recording the additional information code output from the analyzing 
means M8; an additional information writing switch means M4 for passing or blocking the additional information code 
which is output from the analyzing means M8 toward the recording means M5, in response to a control signal M3; a 
conversion means M 10 for converting the additional information code output from the analyzing means M8 or the addi- 

is tional information code read from the recording means M5 into a character or the like; a digital television signal decod- 
ing means M9 for decoding the digital video signal and outputting a video signal; and a signal synthesizing means M7 
for synthesizing the video signal output from the decoding means M9 and the additional information that has been con- 
verted into a character by the conversion means M10, and outputting the synthesized signal as a monitor output signal. 
In the television receiver so constructed, desired information can be selected from television signals in which an ordi- 

20 nary program or commercial and other information (additional information) relating to, or more specific than, the pro- 
gram or commercial, are multiplexed, and the selected information can be collected and recorded. The recorded 
additional information can be used in many ways as a data base. 

As the control signal M3, a recording request signal which is input to the receiver directly by the user who requests 
recording of the additional information is employed. Further, the receiver may be provided with a code comparing 

25 means which retains a code (key word) that shows the additional information for which the user requests recording, and 
outputs a signal that makes the additional information switch means M4 pass the additional information code output 
from the additional information detecting means M1 when the additional information code includes the key word In this 
case, the output signal from the code comparing means can be used as the control signal M3. When the receiver 
includes such a code comparing means, only desired additional information is automatically stored in the additional 

30 information recording means MS after a given period of time, by setting the key word in advance, with no necessity of 
user's requesting recording of the additional information from the outside. 

Rgure 5 is a block diagram illustrating a specific structure of a television receiver according to a second embodi- 
ment of the invention, on the basis of the fundamental structure shown in figure 3. In figure 5, the digitally coded televi- 
sion signal 20 is an MPEG2 -Video stream. Reference numeral 200 designates a stream analyzing means for receiving 

35 the MPEG2-Video stream 20 and separating and extracting an additional information code, such as characters, from 
the stream 20. This stream analyzing means 200 corresponds to the digital television signal analyzing means M8 
shown in figure 2. ON/OFF switching of the stream analyzing means 200 is controlled by an additional information dis- 
play request signal 11 from the user. Reference numeral 201 designates an MPEG2- Video decoder for receiving the 
MPEG2- Video stream 20 and converting the coded video information into a video signal 14. This decoder 201 corre- 

40 sponds to the digital television signal decoding means M9 shown in figure 2. In figure 5, the same reference numerals 
as those shown in figure 2 designate the same or corresponding parts. 

A description is given of the operation of the television receiver shown in figure 5. In the MPEG2-Video stream 20 
to be received, video information and character information are stored in a prescribed format. When the display request 
signal 1 1 from the user is input, the stream analyzing means 200 is turned on, and the analyzing means 200 extracts 

45 additional information, such as characters, from the MPEG2-V1deo stream 20 and outputs an additional information sig- 
nal 16a. It is possible to use, for the additional information, a user data region (8 bits) in the MPEG standard that is 
defined independently. That is, when an identifier of the additional information is '0000 0100* and a commodity code is 
'011001101111 1111 0000 0000', the additional information is defined as follows. 

50 
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15 



20 



~ ,,0000, 0000 0000 0000 0000 0000 1011 0010 ... User Data 
Start Code (0xB2) 

0000 0100 . . • identifier of the additional information 
0110 0110 ... first 8 bits in tlie commodity code of 24 



bits 

1111 1111 . . . 

0000 0000 . . . 

0011 1011 . . . 
Chinese character 

1100 1101 . - . 
Chinese character 



next 8 bits in the commodity code 
last 8 bits in the commodity code 
upper 8 bits in 16 bits showing one 

lower 8 bits in 16 bits showing one 



25 

0000 0000 0000 0000 0000 0001 . . . User Data End Code 



30 Therefore, when the stream analyzing means 200 receives the stream 20 in the format mentioned above, it identi- 
fies that the present stream is the additional information '0000 0100* and the additional information relates to the com- 
modity code '0100 01 10 1111 1111 0000 0000'. The character data can be sent unlimitedly until the User Data End 
Code is sent. 

On the other hand, the MPEG2-Video decoder 201 converts the video information included in the MPEG2-Video 

35 stream 20 into a video signal 14 and outputs the video signal 14 toward the signal synthesizing means 105. The addi- 
tional information code 16a output from the stream analyzing means 200 is subjected to code-to-character conversion 
by the code/character conversion means 109 and stored in the frame memory 104 as data for one picture. In this stage, 
when the recording request signal 12 from the user is input, the switch 106 is turned on, and the additional information 
code 16a output from the stream analyzing means 200 is written in the recording HDD 108. The additional information 

40 stored in the frame memory 1 04 is synthesized with the video signal 1 4 output from the MPEG2- Video decoder 201 , by 
the signal synthesizing means 105. resulting in a monitor output signal 17. 

On the other hand, the additional information recorded in the recording HDD 108 is read from the HDD 108 when 
the reproduction request signal 13 from the user is input and the switch 1 07 is turned on. Thereafter, the additional infor- 
mation reproduced from the HDD 108 is processed through the code/character conversion means 109, the frame mem- 

45 ory 104, and the signal synthesizer 105 in the same manner as mentioned above, resulting in a monitor output signal 
17. This monitor signal 17 is displayed on the monitor screen so that it is split into two pictures on the screen. 

Also in this second embodiment of the invention, as in the first embodiment mentioned above, when a commercial 
is broadcasted, a commodity code requested by the user is reserved in advance, and this commodity code is compared 
with the commodity code included in the MPEG2 -Video stream transmitted by the stream analyzing means 200. Only 

so when the requested code matches the transmitted code, the additional information is recorded in the recording HDD 
108. In this case, a data base wherein information desired by the user is stored is automatically created after a given 
period of time. 

As described above, according to the second embodiment of the present invention, in the digital television receiver 
employing MPEG2- Video system, additional information, which is transmitted with an ordinary video signal, is analyzed 
55 by the stream analyzing means 200, and only the additional information is extracted and output as the additional infor- 
mation code 16a. The additional information code 16a is recorded in the recording HDD 108 in response to the user 
request. On the other hand, the recorded additional information is reproduced from the HDD 108 in response to the 
reproduction request from the user, and displayed. Therefore, the real-time displayed additional information can be cat- 
aloged, and the user can see the catalog anytime, resulting in effective use of the additional information. Furthermore, 
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when the kind of additional information desired by the user is reserved in advance, only the desired additional informa- 
tion is selected and automatically cataloged. That is, the user can collect the additional irrformation.when a given period 
of time has passed, resulting in highly efficient information collection. 

s [Embodiment 3] 

Figure 6 is a block diagram illustrating a television receiver according to a third embodiment of the invention, which 
is based on the fundamental structure shown in figure 2. In figure 6, the same reference numerals as those shown in 
figure 5 designate the same or corresponding parts. Reference numeral 110 designates a code/image conversion 
10 means for converting additional information (image data represented by a bit map code) extracted from the MPEG2- 
Video stream 20 by the stream analyzing means 200 into an image signal. Reference numeral 300 designates a remov- 
able recording medium, such as a floppy disk, that can exchange data with the recording HDD 108. 

A description is given of the operation of the television receiver shown in figure 6. in the television receiver accord- 
ing to the third embodiment, the fundamental operation of recording and reproducing the additional information is iden- 
15 tical to that already described for the television receiver according to the second embodiment In this third embodiment, 
however, since image data is processed as additional information whereas character data is processed in the second 
embodiment, the additional information is in a bit map format, and the data is subjected to code-to-image conversion by 
the conversion means 110. Since the MPEG2- Video format is employed in this third embodiment information of a rel- 
atively large amount, such as graphic information, can be processed as additional information, whereby the range of 
20 multiplication of broadcasting is increased. 

Further, the removable recording medium 300, for example, a floppy disk, is useful for information exchange. Usu- 
ally, the additional information recorded in the recording HDD 108 is read from the HDD 108 and displayed on the mon- 
itor when the user needs to see it. When the user needs to exchange the additional information with another person, 
the user selects necessary information from the HDD 1 08 and writes the information on the floppy disk 300. The person 
25 who receives the floppy disk 300 writes the information recorded in the floppy disk 300 onto his/her HDD 1 08, whereby 
the person can capture the additional information created by another person into his/her data base. Such a removable 
recording medium 300 can be applied to the television receivers according to the first and second embodiments of the 
invention with the same effect as mentioned above. 

30 [Embodiment 4] 

Figure 7 is a block diagram illustrating a television receiver according to a fourth embodiment of the present inven- 
tion. While in the second and third embodiments the entire additional information is written in the user data region of 
the MPEG2-Video stream 20 within the MPEG standard, in this fourth embodiment only a channel number or a still pic- 

35 ture number having detailed information is written in the user data region as additional information. In figure 7, reference 
numeral 400 designates an MPEG2-Video still picture decoder for receiving an additional information (channel number 
or still picture number) signal 19 extracted from the MPEG2- Video stream 20 by the stream analyzing means 200, and 
decoding a channel of the MPEG2-Video stream 20 specified by the additional information or a still picture specified by 
the additional information. In this fourth embodiment, according to the additional information, the MPEG2-Video still pic- 

40 ture decoder 400 decodes the MP EG2 -Video stream 20 and outputs an image signal, and the image signal is recorded 
in the recording HDD 108. 

A description is given of the operation of the television receiver according to the fourth embodiment. The stream 
analyzing means 200 detects an identification code of additional information, a commodity code, and a channel number 
(or a still picture number) having detailed information, which are included in the MPEG2- Video stream 20. Thereafter, 
45 the MPEG2- Video still picture decoder 400 decodes the detected channel pmage) according to the channel number 
(still picture number) that follows the detected channel. It is possible to use, for the additional information, an independ- 
ently defined user data region (8 bits) in the MPEG standard. That is, when an identifier of additional information is 
'0000 01 00* and a commodity code is '01 10 01 10 1 1 1 1 1111 0000 0000', the additional information is defined as follows. 

50 
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15 



20 



0000 0000 0O00 0000 0000 0000 1011 0010 . . . User Data 

Start Code ( 0xB2 ) 

0000 0100 - - . identifier of additional information 
0110 0110 . . - first 8 bits in commodity code of 24 bits 
1111 1111 t . . next 8 bits in the commodity code 
0000 0000 . . . last 8 bits in the commodity code 
0011 1011 . - . channel number (still picture number) 

having detailed information 

1100 1101 ... channel number (still picture number) 

having detailed information 



25 0000 0000 0000 0000 0000 0001 . . • User Data End Code 



Therefore, the stream analyzing means 200 receiving the stream in the format mentioned above can identify that 

30 the present stream is the additional information '0000 0100' and this additional information relates to the commodity 
code '0100 01 101111 1111 0000 0000\ and then the MPEG2-Video still picture decoder 400 decodes the MPEG2- 
Video stream on the basis of the information of the following channel number or still picture number, whereby an imag 
signal, that is, the detailed information, is obtained. This image signal is stored in the frame memory 104. When the 
recording request signal 12 from the user is input, the switch 106 is turned on, and the image signal, that is, the detailed 

35 information, is recorded in the recording HDD 1 08. On the other hand, the MPEG2- Video decoder 201 converts a mov- 
ing picture of the channel of the input MPEG2- Video stream 20, which channel includes the additional information, into 
a video signal 14 by conventional decoding operation, and outputs the video signal 14 toward the signal synthesizing 
means 105. The signal synthesizing means 105 synthesizes the video signal 14 and the image signal stored in the 
frame memory 104, and outputs a monitor signal 17. As a method for synthesizing these signals, screen splitting into 

40 two pictures or overlapping is employed as in the aforementioned embodiments. 

When the reproduction request signal 13 from the user is input, the switch 107 is turned on, and the image signal 
recorded in the HDD 108 is transmitted to the frame memory 104, wherein the image signal is converted to data for one 
picture. This data is input to the signal synthesizing means 1 05 and synthesized with the video signal 14 that is currently 
being received. Finally, the synthesized signal is output as a monitor signal 17. 

45 As described above, according to the fourth embodiment of the present invention, a channel number or a still pic- 
ture number having detailed information is written, as additional information, in the user data region of the MPEG2- 
Video stream 20 within the MPEG2 standard. The MPEG2- Video stream 20 is decoded by the MPEG2-Video still pic- 
ture decoder 400 on the basis of the additional information to produce an image signal and, on the other hand, the 
MPEG2-Video stream is decoded by the MPEG2- Video decoder 201 to produce a video signal 14. The image signal 

so and the video signal 14 so produced are synthesized by the signal synthesizing means 105. Therefore, the additional 
information data is managed collectively. 

Although the additional information is written in the MPEG2- Video layer in this fourth embodiment, it may be written 
in a region in MPEG2-System that is independently defined. This process will be described in more detail using figure 8. 
In figure 8, a stream analyzing means 200 receives an MPEG2-System bit stream 20 (system stream) wherein 

55 video data and audio data coexist and supplies the video stream that is currently being watched and listened by the 
user toward a main decoder 203. Further, when additional video data is appended to the MPEG2-System bit stream, 
this data is supplied to an additional information decoder 202. 

The respective decoders 201 and 202 decode the input streams and convert the streams into video signals. Which 
stream is the additional information of the video stream currently being watched and listened by the user is defined 
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independently by a user-defined region according to a syntax specified in MPEG2-System. 

The additional information is not necessarily a stilt picture. Especially in digital transmissi n, a? moving picture can 
be easily transmitted. 

When the recording request signal 12 from the user is input, the stream (additional information) is recorded in the 
5 recording HDD 108. In this case, since recording of the additional information as it is compressed is possible, the capac- 
ity of the recording medium is used effectively. 

When the reproduction request signal 13 from the user is input, only the additional information stream read from 
the HDD 108 is supplied to the additional information decoder 202 by the selector 204, and the additional information 
is decoded by the decoder 202. The decoded additional information is synthesized with the result of decoding of the 
w main image, i.e., an output from the main image decoder 203, by the signal synthesizing means 105, and the synthe- 
sized signal is output as a monitor output signal 1 7 When the signal 1 7 is displayed on the monitor screen, screen split- 
ting into two pictures (right and left) or picture-in-picture, wherein both the pictures are moving pictures, is employed. 

MPEG2-System and MPEG2-Video employed in the aforementioned embodiments are provided in International 
Standard. 

is Although in the aforementioned embodiments stored data is displayed on a CRT (Cathode Ray Tube) , the data may 

be output to a printer. 

Further, when a television receiver according to any of the aforementioned embodiments is constructed as an inter- 
active communication system, it can be applied to home shopping. A conventional interactive communication system is 
disclosed in, for example, Japanese Published Patent Application No. Hei. 7-123375. 
20 Furthermore, although only the additional information is recorded in the recording HDD 1 08 in the aforementioned 

embodiments, the video signal may be recorded with the additional information. In this case, since the timing of super- 
posing the additional information is delayed from the video signal, in order to record the video signal on the basis of the 
additional information, it is necessary to provide an image memory having a capacity for storing a video signal of about 
15 seconds. 

25 Furthermore, in the second to fourth embodiments of the invention, the content of the additional information, or the 

channel number or still picture number of the additional information is recorded. However, detailed information may be 
obtained by selecting an icon that is displayed on the screen. This process will be described in more detail hereinafter. 

The position of an object having detailed information, such as a commodity, on the screen is defined relating to the 
detailed information at transmission On the receiver's side, an icon is displayed in the position on the screen where the 

30 commodity having the detailed information is shown according to the instruction of the user, and the detailed informa- 
tion corresponding to the position of the icon selected by the user is obtained by decoding another channel or still pic- 
ture, and the detailed information so obtained is displayed on the screen and recorded as desired. 

Also in this case, the additional information can be written in a user data region in the MPEG standard that is 
defined independently. For example, when an identifier of the additional information is '0000 0100* and a commodity 

35 code is ? 01 1001101111 1111 0000 0000', the additional information is defined as follows. 
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,0000 ,0000 0000 0000 0000 0000 1011 0010 • • , User Data 
Start Code (0xB2) 

0000 0100 - . . identifier of the additional information 
OOO0 00OO . _ . upper 8 bits in 16 bits representing 

X- coordinate 

1000 0000 . . . lower 8 bits in 16 bits representing 
x-coordinate 

OOO0 00O1 ... upper 8 bits in 16 bits representing 
Y-coordinate 

O000 Q0OO . . * lower 8 bits in 16 bits representing 
Y-coordinate 

O110 011O ... first 8 bits in the commodity code of 24 

bits 

1111 1111 ... next 8 bits in the commodity code 
0000 0000 ... last 8 bits in the commodity code 
0011 1013 channel number (or still picture number) 

having the detailed information 

1100 1101 ... channel number- (or still picture number) 

having the detailed information 



0000 0000 0000 0000 0000 0001 User Data End Code 



The decoder in the receiver displays the icon in the coordinate position on the screen, for example, (128,256), on 
the basis of the additional information, in response to the user request. When the user selects the icon by remote con- 
trol or the like, the channel or still picture having the detailed information is decoded, and the detailed information of a 
commodity that is displayed in the coordinate position is displayed on the screen. Furthermore, the detailed information 
can be recorded or printed as desired. 

Also in this fourth embodiment, a user-defined region of MPEG2-System may be used for a description of the addi- 
tional information with the same effects as mentioned above. 

Claims 

1 . A television receiver receiving an analog video signal, comprising: 

additional information detecting means for separating and extracting an additional information code from the 
analog video signal, and outputting the additional information code; 

additional information recording means for recording the additional information code output from the additional 
information detecting means; 

additional information writing switch means for passing or blocking the additional information code that is out- 
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put from the additional information detecting means toward the additional information recording means, in 
response to a control signal; 

conversion means for converting the additional information code output from the additional information detect- 
ing means or the additional information code reproduced from the additional information recording means into 
5 a character or an image; and 

signal synthesizing means for synthesizing the analog video signal and the additional information that has 
been converted into a character or an image by the conversion means, and outputting the synthesized signal 
as a monitor output signal. 

10 2. A television receiver receiving a digitally coded television signal, comprising: 

digital television signal analyzing means for analyzing the cfigitally coded television signal, separating and 
extracting additional information included in the television signal from the television signal, and outputting the 
additional information as an additional information code; 
75 additional information recording means for recording the additional information code output from the digital tel- 

evision signal analyzing means; 

additional information writing switch means for passing or blocking the additional information code that is out- 
put from the digital television signal analyzing means toward the additional information recording means, in 
response to a control signal; 

so conversion means for converting the additional information code output from the digital television signal ana- 

lyzing means or the additional information code reproduced from the additional information recording means 
into a character or an image; 

digital television signal decoding means for decoding the digitally coded television signal and outputting a video 
signal; and 

25 signal synthesizing means for synthesizing the video signal output from the decoding means and the additional 

information that has been converted into a character or an image by the conversion means, and outputting the 
synthesized signal as a monitor output signal. 

3. A television receiver as defined in any of claims 1 and 2 wherein the control signal controls the additional informa- 
30 tion writing switch means so that it passes the additional information code only when additional information desig- 
nated by the user is detected. 

4. A television receiver receiving a digitally coded television signal, comprising: 

35 digital television signal analyzing means for analyzing the digitally coded television signal, separating and 

extracting additional information included in the television signal from the television signal, and outputting the 
additional information; 

image signal outputting means for decoding the digitally coded television signal with reference to the additional 
information output from the analyzing means, and outputting detailed information relating to the additional 

40 information as an image signal; 

image signal recording means for recording the image signal output from the image signal outputting means; 
image signal writing switch means for passing or blocking the image signal that is output from the image signal 
outputting means toward the image signal recording means, in response to a control signal; 
digital television signal decoding means for decoding the digitally coded television signal and outputting a video 

45 signal; and 

signal synthesizing means for synthesizing the video signal output from the decoding means and the image 
signal output from the image signal outputting means or the image signal read from the image signal recording 
means, and outputting the synthesized signal as a monitor output signal. 

so 5. A television receiver as defined in claim 4 wherein the digital television signal analyzing means separates and 
extracts a channel number or a still picture number including detailed information, as additional information, from 
the digitally coded television signal. 

6. A television receiver as defined in claim 4 wherein the control signal controls the image signal writing switch means 
55 so that it passes the image signal only when additional information designated by the user is detected. 

7. A television receiver receiving a digitally coded television signal, comprising: 

digital television signal analyzing means for analyzing the digitally coded television signal, separating and 
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extracting additional information that shows the position of an image on a picture, which image is obtained by 
decoding the digitally coded television signal, from the television signal, and outputting the additional informa- 
tion; 

means for displaying an icon in a position on a monitor screen, which position is specified by the additional 
information output from the digital television signal analyzing means; 
means for selecting the icon; and 

image signal outputting means for decoding the digitally coded television signal when the icon is selected, and 
outputting, as an image signal, detailed information that is transmitted corresponding to the position of the icon. 

8. A television receiver as defined in claim 7 comprising detailed information recording means for recording the 
detailed information. 

9. An additional information transmitting method for transmitting a digitally coded television signal in which a program 
or a commercial and additional information relating to, or more specific than, the program or commercial are multi- 
plexed, wherein additional information to be transmitted is written in a user data region of the digitally coded televi- 
sion signal when the additional information is transmitted. 

10. An additional information transmitting method as defined in claim 9 wherein transmitted as the additional informa- 
tion are a code showing an object that provides information, and one of a character information code and an image 
information code, which shows information of the object. 

11. An additional information transmitting method as defined in claim 9 wherein transmitted as the additional informa- 
tion are a code showing an object that provides information, and one of the number of a channel transmitting 
detailed information of the object and the number of a still picture displaying the detailed information of the object. 

12. An additional information transmitting method as defined in claim 9 wherein transmitted as the additional informa- 
tion are a code showing the position of an image on a screen, which image is obtained by decoding the digitally 
coded television signal, and one of the number of a channel transmitting detailed information corresponding to the 
position and the number of a still picture displaying detailed information corresponding to the position. 

13. An additional information transmitting method as defined in claim 9 wherein an MPEG2-Video stream is employed 
as the digitally coded television signal. 

14. An additional information transmitting and receiving method for transmitting and receiving a digitally coded televi- 
sion signal in which a program or a commercial and additional information relating to, or more specific than, the pro- 
gram or commercial are. multiplexed; 

wherein additional information to be transmitted is written in a user data region of the digitally coded televi- 
sion signal when the additional information is transmitted; and 

on the receiver's side, the digitally coded television signal including the additional information is decoded to 
separate the additional information from an ordinary video signal, and the additional information and the video sig- 
nal are reproduced. 

15. An additional information transmitting and receiving method as defined in claim 14; 

wherein transmitted as the additional information are a code showing an object that provides information, 
and one of a character information code and an image information code, which shows information of the object; and 

on the receiver's side, the digitally coded television signal including the additional information is decoded to 
extract, as the additional information, the code showing an object that provides information and the character infor- 
mation code or the image information code, and to extract an ordinary video signal, and the additional information 
and the video signal are produced. 

16. An additional information transmitting and receiving method as defined in claim 14; 

wherein transmitted as the additional information are a code showing an object that provides information, 
and one of the number of a channel transmitting detailed information of the object and the number of a still picture 
displaying the detailed information of the object; and 

on the receiver's side, the digitally coded television signal including the additional information is decoded to 
extract, as the additional information, th code showing an object that provides information and the channel number 
or the still picture number, and to extract an ordinary video signal, and the additional information and the video sig- 
nal are produced. 
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17. An additional information transmitting and receiving method as defined in claim 14; 

wherein transmitted as the additional information are a code showing the position off an. image on a screen, 
which image is obtained by decoding the digitally coded television signal, and one off the numb©- off a channel trans- 
mitting detailed information corresponding to the position and the number off a still picture displaying detailed inffor- 
mation corresponding to the position; 

on the receiver's side, the digitally coded television signal including the additional information is decoded to 
extract, as the additional information, the code showing the position of an image on a screen and the channel 
number or the still picture number; and 

an icon displayed corresponding to a position on a monitor screen, which position is specified by the addi- 
tional information, is selected to reproduce, as a video signal, detailed information corresponding to said position. 

18. An additional information transmitting and receiving method as defined in claim 14 wherein an MPEG2-Video 
stream is employed as the digitally coded television signal. 
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(57) A television receiver receiving an analog video 
signal, comprises additional information detecting 
means for separating and extracting an additional infor- 
mation code from the analog video signal, and output- 
ting the additional information code; additional 
information recording means for recording the addi- 
tional information code output from the additional infor- 
mation detecting means; additional information writing 
switch means for passing or blocking the additional 
information code that is output from the additional infor- 
mation detecting means toward the additional informa- 
tion recording means, in response to a control signal; 

Fig-1 



conversion means for converting the additional informa- 
tion code output from the additional information detect- 
ing means or the additional information code 
reproduced from the additional information recording 
means into a character or an image; and signal synthe- 
sizing means for synthesizing the analog video signal 
and the additional information that has been converted 
into a character or an image by the conversion means, 
and outputting the synthesized signal as a monitor out- 
put signal. 
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